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DISPLAY DEVICE FOR A CAMERA 



BACKGROUND OF THE INVENTION 

1. Field of the Invention 

5 This invention relates to a display device for a camera, and to a method 

for controlling the display device. The invention relates in particular to a 
display device for displaying a stored image, for example, an image previously 
recorded by, and stored in, the camera. 

The invention is particularly, but not exclusively, suited to document 
10 image cameras, i.e. cameras adapted for imaging documents, rather than 
general photography cameras. However, the invention is applicable to all 
forms of camera (for example whether they be document cameras, or general 
digital cameras, or video cameras) in which a display device is provided for 
displaying a stored image. 

15 2. Description of Related Art 

The displays on hand held digital cameras, and hand held video 
cameras, tend to be small. This is a result of the relatively high cost of current 
displays, and the desire for compactness for a portable camera. 

Particularly when a stored image is a document image, in order to 
20 enable the document image to be reviewed in detail, a facility must be 
provided to enable zooming and scrolling of the document image in the small 
display. Additional manually operable controls are therefore required on the 
camera to enable the user to select an image to view, and then to zoom and 
scroll the display over the retrieved image. 

25 The conventional approach is to provide additional control buttons on 

the camera, to provide the necessary control of the display. However, such 
an approach increases the complexity of the interface with the user. It is often 
difficult for a user to press the correct buttons, or simultaneous combination of 
buttons, to provide an optimal path to the region of the image to be viewed. 

30 The user may also have to take his or her eyes off the image to locate the 
desired control buttons, which makes the camera less convenient, and slower, 
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to use. Moreover, control buttons do not enable the user to control variably 
the scroll speed or the zoom speed. 

A touch sensitive display could be provided to allow the user to control 
the image by touching or dragging areas on the display screen. However, this 

5 normally requires both hands if the user is holding the camera. Touch 
screens can also be difficult to use particularly on small displays. If the user's 
finger is large relative to the display, then the finger cannot be moved very far 
and the finger occludes the user's view of the image. Additionally, a small 
display will usually be near the user's eye, which makes the display difficult to 

10 access with the finger. Such closeness also means that the user's finger and 
the display itself will not be simultaneously in focus. 

US Patent No. 5,844,824 describe a hands-free portable computer 
which uses eye-tracking for shifting the effective field of view in the display. 
However, such displays are more complex and expensive, and presently less 
15 reliable to use. 

Reference may be made to head-mounted displays (e.g. US Patent No. 
6,01 1 ,526) and to tip-tilt Personal Data Assistants (PDA's). 

SUMMARY OF THE INVENTION 

It would be desirable to provide a camera with an interface for 
20 reviewing stored images, which can provide an easier, more intuitive way of 
controlling the display of a region of an image. 

In contrast to the prior art techniques described above, broadly 
speaking one aspect of the present invention is to provide an interface for 
viewing stored images, wherein the selection and/or display of a stored image 
25 is controlled (at least partly) by physical movement of the camera. 

This can provide a much more straightforward interface for the user, 
without the difficulty of finding, and trying combinations of buttons to control 
the display. It is also less fatiguing to the users. 

In a preferred form, many of the image or display control operations are 
30 simply movements which the user would make if viewing the images through 
a lens or window. This can provide a highly intuitive manner of operation. 
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The motion interface may be used for controlling the selection of an 
image to view from a selection scene, and/or for controlling the display of a 
stored image after selection. 

The invention may be embodied as, or in, a camera, or a method of 
5 operation, or a program for controlling or implementing such a method when 
run on a processor. 

BRIEF DESCRIPTION OF THE DRAWINGS 

An embodiment of the invention is now described by way of example 
only, with reference to the accompanying drawings, in which: 

10 Fig. 1 is a schematic perspective rear view of a document imaging 

camera; 

Fig. 2 is a schematic block diagram of a section of the camera for 
displaying stored images; 

Fig. 3 is a schematic illustration of an image selection scene; 

15 Fig. 4 is a schematic illustration of a larger image selection screen; 

Figs. 5a and 5b show schematically an image viewing process; 

Fig. 6 is a schematic block diagram of an example motion sensor used 
in the camera; and 

Fig. 7 is a schematic block diagram of an alternative zoom control for 
20 use in the motion sensor of Fig. 6. 

DETAILED DESCRIPTION 

Referring to the drawings, a portable document imaging camera 10 
comprises a camera housing 12. As used herein, the term "document" 
camera refers to a camera which is configured or adapted to make it 
25 especially suitable for capturing or encoding or reviewing document images. 
The camera therefore has a resolution sufficient to enable subsequent 
document processing of the document image. 

The camera 10 includes a conventional lens and shutter assembly, a 
conventional photoelectric input device for capturing the image, and a 
30 conventional recording device for recording the image onto a storage medium 
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14. The medium may, for example, be a semiconductor memory, or an 
optical disc, or a magnetic disc, or a magnetic tape. Suitable constructions for 
the above conventional sections are well known to the skilled man, and so 
need not be described here in detail. 

5 The camera 10 also includes an interface 16 for enabling the camera 

10 to communicate with an external device 18, to allow images stored in the 
camera to be uploaded into the external device 18. The interface 16 also 
permits images to be downloaded from the external device 18 into the camera 
10. The interface may be a connector socket, or it may be a wireless 

10 interface, for example, a wireless LAN connection. 

The camera housing 12 carries a display device 20 for displaying 
images, to enable the user to view images prior to storage, and to view 
images after storage. In this embodiment, the display device 20 is mounted 
on the rear of the camera housing 12, and consists of a multi-pixel LCD 
15 display. 

For controlling the display of stored images, the camera 10 includes an 
image rendering circuit 22 for creating the image to be displayed on the 
display device 20. The image rendering circuit 22 receives image data from 
the storage medium 14, and composes an image for display. The image 
20 rendering circuit 22 provides the following image-processing functions: 

(a) Synthesis of a selection scene of a plurality of stored images, to 
permit selection of an image from the plural images; 

(b) Scrolling or panning of the selection scene; 

(c) Scrolling or panning of a stored image; and 

25 (d) Zooming of a stored image. 

The camera also comprises a motion sensing device 24 for sensing 
movement of the camera. The output from the motion sensing device 24 is 
fed as a control input to the image rendering circuit 22, to control the 
displayed image based on the user's movement of the camera. 

30 The motion sensing device 24 may be a device which detects motion in 

two dimensions, for example, movement in a plane to effect scrolling of the 
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display in a corresponding direction of the display device 20. For exannple, 
the plane may be perpendicular to a predetermined axis 26 relative to which 
motion is judged. As illustrated by the arrows 28 in Fig. 1, the plane may be 
generally parallel to the plane of the display device 20. 

5 Additionally, or alternatively, the motion sensing device 24 may detect 

the attitude of the camera 10, so that tilting the camera in a certain direction 
effects scrolling of the display in a corresponding direction of the display 
device 20. This might be advantageous if, for example, the camera is used in 
small space or if it is not practical to move the camera significantly. 

10 The motion sensing device 24 may also detect movement in three 

dimensions, such that movement in a direction parallel to the axis 26 may also 
be detected. Such movement may be used to effect zooming of the display. 
The zoom may either be such that movement of the camera away from the 
user effects magnification (in a similar manner to moving a camera toward a 

15 hypothetical object), or it may be such that movement of the camera towards 
the user effects magnification (in a manner similar to bringing a piece of paper 
nearer to the user's eyes). 

Example motion detection devices for detecting camera movement are 
described later. 

20 The rendering circuit 22 also receives an input from a mode input 

device 30, in the form of a manually operable push button, for selecting one or 
more operating modes of the camera. In the present embodiment, the mode 
input device 30 is operable to initiate a scene selection mode, which causes 
the image rendering circuit 22 to generate the synthesized image selection 

25 scene for display on the display device 20. Referring to Fig. 3, the selection 
scene 32 consists of a plurality of icons or thumbnail views 34 representing 
the stored images. Each thumbnail view 34 may be a low-resolution 
rendering of the image it represents or, in the case of a video clip, a low- 
resolution rendering of a key image from the clip. 

30 The selection scene 32 may be a one-dimensional (e.g. horizontal) 

array of the icons or thumbnail views or, as illustrated in Fig. 3, the selection 
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scene 32 may be a two-dimensional array. The order of the icons/thumbnail 
views 34 preferably indicates the order in which the images were acquired. 

In the present embodiment, the size of the icons/thumbnail views 34 is 
such that the display device 20 can display up to six icons/thumbnail views 
5 simultaneously, as illustrated in Fig. 3. However, referring to Fig. 4, if the 
number of icons or thumbnail views 34 exceeds the number which can be 
displayed, then the display device displays a panable window 36 within the 
generated selection scene 32. Although in the illustrated embodiment, the 
icons/thumbnail views 34 have a fixed size, the size could be made to vary 
10 depending on the size of the stored image. This would enable the user see 
clearly the relative size or scale of each image. 

The image rendering circuit 22 receives a further input from a "motion 
interface selection" input device 38, in the form of a push button, for enabling 
image control by motion of the camera. The input may either be a push 
15 button which the user has to press continuously while the motion interface is 
enabled, or it may be a simple on/off selection button. 

When enabled by the motion interface selection input device 38, the 
panable window 36 can be panned left or right, or up and down, within the 
selection scene, by corresponding movement of the camera. As described 
20 above, the detected movement is fed as an output from the motion sensing 
device 24 to the image rendering circuit 22, to control the displayed image. 

The peripheral boundaries 40 of the selection scene 32 are highlighted 
in the display, for example, by red borderlines, so that the user can identify 
the "edges" of the generated scene. The rendering circuit 22 can be 
25 configured either to prevent the panable window 36 from moving outside the 
selection scene, or to "wrap" the selection scene as a continuous loop, such 
that movement of the panable window 36 past a boundary 40 causes the 
scene to repeat. 

The image rendering circuit 22 receives a further input from a scene 
30 selection input device 42, in the form of a manually operable push button, 
which may conveniently be the same button as the shutter release button 
(shown in Fig. 1 as 44). Pressing this button selects the icon or thumbnail 
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view 34 currently in the center of the display, so that the corresponding stored 
image or video clip is then displayed. 

As explained above, zoom control may be provided by movement of 
the camera 10 in a direction parallel to the axis 26 if the motion sensing 
5 device 24 is capable of detecting movement in that direction. In addition, or 
alternatively, a separate zoom control input device 46 may be provided 
(shown optionally in Fig. 2), for example in the form of push buttons, or a 
variable analog device. This may conveniently be the same zoom control as 
that provided for zooming during image capture. 

10 A typical example of image selection and viewing will now be described 

with reference to Figs. 5a and 5b. Firstly, at step 48, the user operates the 
mode input button 30 to set the camera in the selection mode in which the 
selection scene 32 is generated and displayed on the display device 20. 

Next, at step 50, the user operates the motion interface selection 
15 button 38 to enable motion control of the image and, at step 52, the user 
moves the camera to pan right. As explained above, such movement could 
either be movement of the camera rightwards, or it may be tilting the camera 
to the right. This causes the image to move leftwards in the display device 
20, bringing the rightmost thumbnail view 34 to the top center of the display 
20 (indicated at 54). 

Next, at step 56, the user presses the scene selection input button 42, 
to select the currently centered image thumbnail 34 for display. The stored 
image corresponding to the selected thumbnail view is retrieved, and 
displayed by the display device 20 (indicated at 58). 

25 Next, at step 60, the user zooms in to enlarge a portion of the image, 

while panning the image left, i.e. to zoom towards the top left of the document 
image (indicated at 62). The zoom may be effected either by moving the 
camera in a direction parallel to the axis 26, or by operating the camera's 
zoom input buttons 46. The panning left is effected by appropriate movement 

30 of the camera 1 0, for example movement leftwards or tilting to the left. 

If desired, the same form of boundary "wrapping" may be used for the 
stored image as that described above for panning of the selection scene 32. 
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This would enable a single column docunnent to be read simply by moving the 
camera in a single direction, rather than by repeated left-right motions of the 
camera. However, the reader is not forced to use this manner of reading if 
the repeated left-right motion for reading is preferred. 

5 It will be appreciated that, as illustrated above, the image 

icons/thumbnails and the stored images themselves, can be reviewed quickly 
and easily. To the user, many of the control operations are simply 
movements which the user would make if viewing the images through a lens 
or window. This can provide a highly intuitive manner of operation. 

10 When displaying video clips, one might have the option of adding the 

motions that the camera makes at the time of playback to the motions made 
when the clip was acquired (if those motions were recorded, for example, by 
the motion sensing device 24 of the camera). Thus, were the camera panned 
at some point during the original recording, a fixed viewpoint could be 

15 maintained in the playback (within the limits of the image actually recorded). 

A first example of a motion sensing device 24 is now described with 
reference to Fig. 6. This first example merely detects motion in two 
dimensions (called the x-y dimensions) perpendicular to the axis 26 (Fig. 1). 

The motion sensing device comprises accelerometers 70 arranged 
20 within the camera 10 to sense accelerations in the x-y directions, i.e. 
directions generally parallel to the plane of the display device 22. A suitable 
accelerometer is the Analog Devices ADXL50. The output from the 
accelerometers is fed through a band-pass filter 72. The low frequency cut-off 
characteristic of the bandpass filter removes the effect of gravity (as a 
25 constant acceleration), and the high frequency cut-off characteristic is chosen 
to remove the effects of noise, human jitter and accidental vibration of the 
camera. The filter bandwidth in this embodiment is about 1-10 Hz, and is 
chosen to match human head motion, which averages about 3.5-8 Hz. 

The output from the bandpass filter 72 is fed to a first integrator 74 
30 which integrates the acceleration signal to produce a velocity signal. The first 
integrator 74 has an exponential decay to reduce drift. 
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The velocity signal is then fed to a multiplier 76 which multiplies the 
velocity by a factor k which is a function of the current zoom setting of the 
image rendering circuit 22 (i.e. the extent to which the currently displayed 
image is zoomed). The purpose of the factor k is to vary the panning speed 
5 depending on the current level of zoom. The factor k is smaller for higher 
zooming, such that the motion detection system becomes less sensitive to x-y 
acceleration when the image display is zoomed in, and hence more 
convenient for the user. The factor k is determined by a virtual velocity gain 
circuit 78 which receives a zoom input from a zoom control input device 46. 

10 The multiplier 76 also receives an enable control signal from the motion 

interface selection input device 38. The control signal is either zero (motion 
interface disabled) or one (motion interface enabled), which is used to multiply 
the velocity signal in the multiplier 76. This is effectively a switch for switching 
on or off the signal from the multiplier. 

15 The output from the multiplier 76 is fed to a second integrator 80 which 

integrates the velocity signal to a position signal. The second integrator also 
has an exponential decay to reduce drift. The output from the second 
integrator 80, and the output from the zoom control input device 46 are fed as 
X, y and z coordinates to the image rendering circuit 22, with x and y 

20 representing the current panning position within the image, and z representing 
the level of zoom. 

Although only a single schematic channel is illustrated in Fig. 6, it will 
be appreciated that separate processing channels are provided for the x and y 
signals. 

25 Fig. 7 illustrates an alternative zoom input circuit 46a as an alternative 

to the manually operated zoom circuit 46 in Fig. 6. The circuit of Fig. 7 
includes an accelerometer 82 mounted for sensing acceleration in the "z" 
direction, i.e. parallel to the axis 26 (fig. 1). The output from the 
accelerometer 82 is fed through a bandpass filter 84 similar to the filter 72, 

30 and through a two stage integrator 86 which doubly integrates the 
acceleration signal to a "z" position signal indicative of the level of zoom. The 
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output from the input circuit 46a can be fed to the virtual velocity gain circuit 
78 and to the image rendering circuit 22. 

In the motion sensors illustrated in Figs. 6 and 7, the effect of gravity is 
removed by bandpass filtering. As an alternative, the motion sensing device 
5 24 could include a gyroscope, or use integrated rotational accelerometers, to 
estimate the gravity direction. Such a technique is described, for example, in 
IBM Systems Journal, Vol. 35, 1996. 

Also, some accelerometers tend to have poor response at low 
frequencies. If such accelerometers are used, then remedial action to remove 
10 the effect of gravity might be unnecessary. 

It will be appreciated that the foregoing description is merely descriptive 
of preferred non-limiting embodiments of the invention, and does not limit the 
invention in any way. The skilled man will appreciate that many equivalents 
and modifications may be used without departing from the scope and spirit of 
15 the invention. 
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